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Abstract — This paper corrects an unclear treatment of the conventional Kalman 
filter implementation as presented by M. H. Verhaegen and P. van Dooren in “Numeri- 
cal aspects of different Kalman filter implementations,” IEEE IVans. Automat. Contr., 
vol. AC-31, no. 10, pp. 907-917, 1986. 

This paper shows that habitual, incorrect implementation of the Kalman filter has 
been the major cause of its sensitivity to the so-called loss-of-symmetry phenomenon. 
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I. Introduction 


The loss of symmetry of the state-error-covariance matrix is a well-known phe- 
nomenon in the use of the conventional Kalman filter (CKF). This phenomenon has been 
recognized in experimental (simulation) studies from the origin of the Kalman filter in 1960 
[1]. Only recently has a theoretical explanation been given for this phenomenon [2j. 

From comments received about this paper [2], the given explanation might be sub- 
jected to a misinterpretation, which results mainly from the “unclear” specification of what 
was referred to as the CKF implementation. 

In this paper the deficiency is corrected by using the theoretical-error-analysis frame- 
work constructed in [2j. Also, the notation introduced in [2] will be retained. 


II. The Conventional Kalman Filter Implementations 

Recall the CKF recursions used in [2]: 

R‘ k = R k + C k P k \ k - l C' k (2.1) 

Kk = JViCiW]-’ (*•*) 

Pm |t = >!*[/- + B t Q„B' t . (2.3) 

The matrix multiplications in the set of recursive relationships (2.1)-(2.3) might be 
(and have been) executed in various ways. When doing this, it is not even necessary to 
modify the structure of the relationships as in such altered forms as the so-called (Joseph’s) 
stabilized Kidman filter [3]. Therefore, by focusing on the recursive relationships as given by 
(2.1)-(2.3), we compare the behavior of two different implementations. A first, and widely 
used, implementation is represented in Table I as the CKF1. The second implementation, 
which is the exact execution of the matrix multiplications, is also represented in Table I as 
the CKF2. 
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TABLE I 

The CKF1 and CKF2 Implementation of the Conventional Kalman Filter 


CKFl 

i 

quantity 

mathematical expression 

number of flops 

CP 

C’fc x Pk\k-\ 

n 2 p 

Rl 

CP xC' k + R k 

np 2 

[Ri )- 1 

[Ri]- 1 

P 3 

K k 

CP 1 x.^]- 1 

n P 2 

Pi 

- Kk x CP) 

n 2 p 


A k x PI x A! k + Bk x Q k x B' k 

2 n 3 + n 2 m + m 2 n 

CKF2 

quantity 

mathematical expression 

number of flops 

CP 

★ 

★ 

Ri 

★ 

★ 

[ri r 1 

★ 

★ 

Kk 

Pk |*_1 x C'„ x 

2 2 

np * + rrp 

Pi 

★ 

★ 

P k+l\k 

★ 

• 


The notation of the * in Table I indicates that the same mathematical expression is 
used for the CKF2 implementation as for the CKFl implementation. This table, therefore, 
clearly shows that the only minor difference in the two implementations is in the calculation 
of the Kalman gain, K *. The CKFl in this step exploits the symmetry of Pk\ k -u thereby 
decreasing the computational complexity. However, it will be shown in the next subsection 
that it is precisely this fact that makes the implementation especially sensitive to the loss 
of symmetry. 


III. Theoretical Error Analysis 

In this section the same theoretical-error-analysis framework defined in [2] is used to 
analyze the propagation of errors through the implementations CKFl and CKF2, described 
in Section II. 
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Therefore, consider again the representation of the error 5Pk\k-\ on the state-error- 
covariance matrix Pt\k-i : 

Pk\k-l ~ Pk\k-l + & P k\k-l- ( 3<1 ) 

This single error then builds up through the recursive relationships of the CKFl and CKF2 
implementation as represented in Table II [2]. Here, infinite precision of the computations 
was assumed. 
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TABLE H 


Propagation of a Single Error 6P k \ k -i Through the CKF1 and CKF2 Implementation of 


the Conventional Kalman Filter, Using Exact Arithmetic 


CKF1 

quantity 

error 

C k P k \ k -l 

c k &P k \ k -\ 


-[Rk}~ l Ck&P k \ k -iC' k {R k \~ 1 + 0(6*) 

K k 


n 

«ni,-.c;w]- 1 c t p,i,- 1 +o(« : ) 

^*+ 11 * 

A,(SP, It; - Pl,t;CilJnr‘CtSPtlt;+ 

P't l t;C l M' l Ct(Pt,t;C' t [K\~ l Cl.Ptlt- l - 

+ o(< ! ) 

CKF2 

quantity 

error 

C k .P k \ k ~\ 

Ck6P k \ k -i 


-[R e k }- 1 C k 6P k ^ 1 C > k \R e k }^ + 0(6*) 

Kk 

-P k \ k -iC k \R k }~ l C k 6P k \ k -iC , k [R k }- 1 + 

6Pk\k-iC' k [R‘ k )-'+0(6*) 

n 

6Pk\k-i - / > k|k-i^[^r 1 C fc 5P fclk . 1 + 
5P k n_ 1 c;[f^]- 1 c t p*|*- 1 + o(s *) 

P k+\\k 

A*(^P k | k -i “ •Pk|k-lCkf^ki _1< - : 'k^^ , k|k-l + 

sPk^c'M-'CtP^-M'k + °(* 2 ) 
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Summarizing, the error propagation model for the CKF1 becomes: 

&Pk+i\k = FkSPk \k-iK + Ak{6Pk\k-i ~ t>P‘k\ k -i)C'kK'k + 0(S 2 ) (3.2) 

while the model for the CKF2 is: 

+ 0(«’). (3.3) 

In the equations 3.2 and 3.3, F k is the Kalman filter transition matrix (.4* - A k K k Ck)- The 
error propagation model (3.2) was also obtained in [2]. However, it is now clear to which 
of the CKF implementations it corresponds. 

The conclusion from this analysis is that an asymmetric error on the state-error- 
covariance matrix in the CKF1 implementation leads to divergence due to the loss of sym- 
metry when the original transition matrix A k is unstable. This phenomenon is a consequence 
of the implementation, and occurs irrespective of the machine precision. However, when 
one uses the almost identical implementation of the CKF2, such asymmetric error vanishes 
when the Kalman filter (KF) has converged. 

This analysis clearly shows that the slightly more economical and error-prone imple- 
mentation of the recursive relationships (2.1)-(2.3), as represented by the CKF1 in Table I, 
is responsible for the loss-of-symmetry phenomenon, which has been so blindly associated 
with the CKF in general. 

In the next section, the above conclusion is verified in an experimental simulation 

study. 

IV. Experimental Evaluation 


The system representation taken in this experimental analysis is the one used in 
test 1 of [2j. The attribute of this (time invariant) system model, which is important for 
the round-off propagation behavior of the two CKF implementations under consideration, 
is the location of all the eigenvalues of the system transition matrix A on the unit circle. 
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Following the assumption as in [2], the single-precision computed quantities, denoted 
by (.), are the erroneous quantities, and the double-precision ones are considered to be error- 
free. In this way, the errors on the quantities in the KF recursion are approximated by the 
difference between their single-precision and their double-precision updates. 

In order to verify the conclusion made in the previous section, both the CKFl and 
CKF2 implementations are executed for the first 100 recursions in single- precision, and 
from then on, continue in (double-precision) exact arithmetic. The resulting quantities 
updated in the Kalman recursion, as denoted in Table I, are then compared to the same 
quantities updated in exact arithmetic from the first recursion on. The (Frobenius) norm 
of the differences of these quantities is plotted in Fig. 1 for the CKFl and in Fig. 2 for the 
CKF2. These figures obviously demonstrate the conclusion made in Section III. 


V. Concluding Remarks 

The purpose of the analysis in this paper was to clarify a possible misinterpretation 
of a theoretical explanation given in [2] of the loss-of-symmetry phenomenon of the CKF. 
The analysis has clearly demonstrated that an “error-prone” way of implementing the CKF 
has been responsible for the conviction that this filter is the inherent cause of the well-known 
loss-of-symmetry phenomenon. 

Furthermore, the power of the outlined theoretical-error-analysis framework in [2] 
to analyze the robustness of (Kalman filter) algorithms is again demonstrated. 


7 



References 


[1] R. E. Kalman, “A new approach to linear filtering and prediction problems,” Trans. 
AS ME. (J. Basic Eng.), vol. 82D, pp. 34-45, Mar. 1960. 

[2] M. H. Verhaegen and P. Van Dooren, “Numerical aspects of different Kalman filter 
implementations,” IEEE Trans. Automat. Contr., vol. AC-31, no. 10, pp. 907-917, 
1986. 

[3] B. D. O. Anderson and J. B. Moore, Optimal Filtering. Englewood Cliffs, New Jersey: 
Prentice Hall, Information and System Sciences Series, 1979. 


8 



Figure Captions 


Fig. 1. Propagation of round-off errors iff the CKFl implementation. 
Fig. 2. Propagation of round-off errors in the CKF2 implementation. 
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(a) THE LOSS OF SYMMETRY IN THE MATRICES Rj"\ pj AND 
'Vt/k 0F THE CKF1 IMPLEMENTATION 



NUMBER OF RECURSIONS, k 

(b) ERRORS ON R^* 1 , K k , pj AND P^-,^ OF THE CKF1 
IMPLEMENTATION 


Fig. 1 
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NUMBER OF RECURSIONS, k 


(a) THE LOSS OF SYMMETRY IN THE MATRICES Rj" 1 , P£ AND 
P k+1/k 0F THE CKF2 IMPLEMENTATION 



NUMBER OF RECURSIONS, k 

(b) ERRORS ON Rf 1 , K k , Pj AND P k+1/k OF THE CKF2 
IMPLEMENTATION 

Fig, 2 
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